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Presentation  Outline 
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•  Introduction  to  Dynamic  Discovery  Protocols 

■  Project  Motivation 

■  Goals  &  Technical  Approach 

■  Generic  Model  Encompassing  (Five)  Discovery  Protocols 


•  Modeling  &  Analysis 

■  Architecture-based  Approach 

■  FY01  Accomplishments 


•  Measurement 

■  Measurement  Methodology 

■  Synthetic  Workload  Generation 

■  FY01  Accomplishments 


•  Project  Plans  for  FY02 


•  Supplemental  Material  (included  but  not  presented) 

■  Includes  list  of  papers,  software  artifacts,  and  presentations 

■  Includes  sample  results  from  modeling,  analysis,  &  measurement 
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What  is  a  dynamic  discovery  protocoi? 

Dynamic  discovery  protocols  enable  network  elements  (including  software 
clients  and  services,  as  well  as  devices): 

(1 )  to  discover  each  other  without  prior  arrangement, 

(2)  to  express  opportunities  for  collaboration, 

(3)  to  compose  themselves  into  larger  collections  that  cooperate  to  meet 
an  application  need,  and 

(4)  to  detect  and  adapt  to  changes  in  network  topology. 


Why  anaiyze  dynamic  discovery  protocois? 

•  In  the  future,  all  software  systems  will  be  distributed  systems 
written  to  operate  over  a  network,  where  conditions  vary. 

•  Dynamic  discovery  protocols  provide  a  foundation  upon  which 
such  distributed  systems  will  be  constructed. 

•  Understanding  the  current  (first)  generation  of  discovery  protocols 
essentiai  to  enable  government  agencies  to  establish  requirements 
and  to  help  industry  to  improve  designs  for  the  second  and 
subsequent  generations. 
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Our  Goal _ 

To  provide  metrics  and  approaches  to  compare  and  contrast  emerging 
dynamic  discovery  protocols,  to  better  understand  their  critical 
functions,  to  identify  weaknesses,  and  to  strengthen  the  quality  and 
correctness  of  designs  for  future  protocols. 


Our  General  Technical  Approach 

•  Build  a  generic,  domain  model  (UML)  providing  consistent  terminology 
encompassing  a  range  of  service  discovery  protocols. 

•  Build  executable  models  of  service  discovery  protocols  from  extant 
specifications,  and  analyze  them  under  conditions  of  dynamic  change. 

•  Build  measurement  infrastructure  and  measure  implementations  of 
dynamic  service  protocols  for  scalability. 

•  Build  simulation  models  of  dynamic  service  protocols  and  assess  the 
adaptability  of  such  models  to  dynamic  change. 

•  Design,  model,  and  evaluate  protocol  mechanisms  that  enable 
discovery  protocols  to  self-adapt  in  the  face  of  dynamic  change  (this  part 
of  the  project  is  funded  by  the  DARPA  Fauit  Toierant  Networks  program). 
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Technical  Approach  to  Modeling  &  Analysis 

•  Model  Discovery  Protocol  specifications  using  Architectural 
Description  Languages  (ADLs)  and  associated  tools 

•  Analyze  Discovery  Protocol  models  to  assess  consistency,  correctness, 
and  completeness  under  conditions  of  dynamic  change. 

•  Compare  and  contrast  our  models  with  regard  to  function,  structure, 
behavior,  performance,  complexity,  and  scalability  under  conditions  of 
dynamic  change. 


Technical  Approach  to  Measurement 

•  Design  technology-independent  benchmark  service  and  scenarios. 

•  Create  synthetic  workload  generation  tools  for  emulating  the 
behavior  of  large-scale  dynamic  ad  hoc  networking  environments. 

•  Develop  implementation-independent  performance  measurement 
methodologies  and  tools  for  service  discovery  protocols  (SDPs)  and 
required  supporting  protocols. 
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Foundation  for  Comparisons:  A  Generic  Structurai  Modei 

(UML)  for  Service-Discovery  Domain 
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Architecture-based  Approach  to  Modeling  and  Analysis 

(using  Rapide,  an  Architecture  Description  Language  and  Toois 

Deveioped  for  DARPA  by  Stanford) 


Time 
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5 
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__!|«*************************************************** 

-**3.3  DIRECTED  DISCOVERY  CLIENT  INTERFACE  ** 

—  This  is  used  by  all  JINI  entities  in  directed 

—  discovery  mode.  It  is  part  of  the  SCM  Discovery 

-  Module.  Sends  Unicast  messages  to  SCMs  on  list  of 

-  SCMS  to  be  discovered  until  all  SCMS  are  found. 

—  Receives  updates  from  SCM  DB  of  discovered  SCMs  and 

-  removes  SCMs  accordingly 

—  NOTE:  Failure  and  recovery  behavior  are  not 

-  yet  defined  and  need  reviw. 

TYPE  Directed  Discovery  Client 

(SourcelD  :  IP  Address;  InSCMsToDiscover  :  SCMList;  StartOption  :  DD  Code; 
InRequestInterval :  TimeUnit;  InMaxNnmTries  :  integer;  InPV  :  ProtocolVersion) 

IS  INTERFACE 

SERVICE  DDC  SEND  DIR  :  DIRECTED  2  STEP  PROTOCOL; 

SERVICE  DISC  MODES  :  dual  SCM  DISCOVERY  MODES; 

SERVICE  DD  SCM  Update  :  DD  SCM  Update; 

SERVICE  SCM  Update  :  SCM  Update; 

SERVICE  DB  Update  :  dual  DB  Update; 

SERVICE  NODE  FAILURES  :  NODE  FAILURES;  -  events  for  failure  and  recovery. 
ACTION 

IN  Send_Requests(), 

BeginDirectedDiscoveryO; 

BEHAVIOR 

action  animation  lam  (name:  string); 

MySourcelD  :  VAR  IP  Address; 

PV  :  VAR  ProtocolVersion; 
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Real-Time  Checking  of  Consistency  Conditions 


Sample  Consistency  Condition* 

For  All  (SM,  SD,  SCM):  (SM,  SD)  IsElementOf  SCM  registered-services 

implies  SCM  IsElementOf  SM  known-SCMs 

...that  is,  a  Service  Manager  shouid  register  its  Services  on  an  Service 
Cache  Manager  only  if  it  maintains  that  Cache  Manager  on  its  “known 
SCM”  List. 

^Assuming  absence  of  network  failure  and  normal  delays  due  to  updates 


•  SM  is  Service  Manager 

•  SD  is  Service  Description 

•  SCM  is  Service  Cache  Manager 


•  registered-services  is  a  set  of  (SM,SD)  pairs 

•  known-SCMs  is  a  set  of  SCMs 


Same  executable  model  can  be  used  to  assess  selected  performance 
properties  and  to  measure  complexity* 


^future  work  on  the  project  intends  to  investigate  the  relationship  between  design  complexity  (applying 
ideas  from  Kolmogorov  Complexity)  and  design  quality  (as  represented  by  violation  of  consistency 
conditions) 
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Off-Line  Analysis  of  POSETs  to  Compare  and  Contrast 
Behaviors  Given  a  Congruent  Topology  and  Scenario 


duality  Metrics 

•  Count  of  consistency  violations? 


Performance  Metrics 

•  Message  volume? 

•  Message  intensity? 

•  Discovery  latency? 

•  Query  latency? 

•  Recovery  latency? 

Complexity  Metrics 

•  Description  length  of  models  (static  and 
dynamic  forms)  ? 

•  Compressibility  of  message  exchanges? 

•  Cyclomatic  measure  of  models? 

•  Time-Space  computational  complexity? 


POSET  analyses  provide  basis  for  defining  metrics  that  provide 
quantitative  measures  of  properties  of  a  modeled  system 
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Modeling  &  Analysis:  FY01  Accomplishments 


•  Developed  an  initial  UML  model  of  a  generic  service  discovery  protocol  with  specific 
projections  for  Jini,  UPnP,  and  SLP  (the  three  most  general  discovery  protocols) 

•  Developed  and  exercised  an  executable  Rapide  model  of  Jini,  including  selected 
consistency  conditions  and  performance  metrics.  (Proving  our  concept,  with  the 
exception  of  complexity  metrics,  which  require  us  to  complete  at  least  a  second  model.) 

•  Briefed  Jini  modeling  at  PC2001,  and  provided  Jini  designers  with  results  of  analysis 
(see  examples  in  the  supplemental  material). 

•  Wrote  paper,  “Analyzing  Properties  and  Behavior  of  Service  Discovery  Protocols  using 
an  Architecture-based  Approach”,  and  submitted  it  to  an  upcoming  Conference  on 
Complex  and  Dynamic  Systems  Architecture 

Anticipated  Additional  FY01  Accomplishments 

•  Develop  an  executable  Rapide  model  of  Universal  Plug-and-Play  (UPnP)  subset 

•  Devise  some  performance  scenarios  against  which  to  compare  UPnP  and  Jini 

•  Define  possible  complexity  and  quality  metrics  to  use  in  comparing  discovery 
protocols 
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Measuring  Performance  and  Scaling 
of  Service  Discovery  Protocols 

•  What  are  the  performance  requirements  for  SDPs? 

-  First  generation  SDPs  designed  around  consumer 
applications. 

•  1 0’s  of  consumer  electronic  devices  in  the  home. 

•  1 0Os-1 000s  of  shoppers  walking  about. 

•  10,000s-?  cars  on  a  highway. 

-  Requirements  for  DoD  applications? 

•  Scale 

-  Number  of  nodes,  services,  directories,  and  clients? 

-  Size  of  PC  network  topologies? 

•  Dynamic  Range 

-  Rate  of  service/client  arrival  departure?  _ 

-  Service  load  of  advertisements,  queries,  control,  events? 

-  Latency  requirements  for  service  discovery? 

•  Network  Technologies 

-  Range  of  link  technologies? 

-  Performance  of  WAN  connections? 
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Measurement  Methodology 


•  SDP  Architectures  &  Protocols  Differ  Considerably 

-  Directory  based  vs  flat  peer-to-peer  (combinations) 

-  Java  RMI  and  Serialized  Objects  vs.  HTTP/SOAP/GENA  and  XML 

•  How  to  reasonably  compare  the  performance  of  such  diverse  technologies? 

•  Usage-Based  Scenarios  &  Metrics 

-  Service  initiation  -  restart,  auto  configuration,  advertisement,  renewal 

-  Client  active  query  -  restart,  by  name,  single  instance,  multiple  instances,  all  instances 

-  Client  passive  monitoring  -  persistent  query  for  new  instances,  network  restart 

-  Event  Notification  and  control  -  registration  latency,  notification  latency,  distributed  control 
performance  (control  +  event  notification). 

•  SDP-Independent  Benchmark  Service  - 

-  Simple  counting  device/service  that  can  be  used  to  exercise  all  significant 
discovery/control  capabilities  of  Jini  and  UPnP. 

-  Supports  -  get/set  service,  GU IDs/attributes/type,  control,  event  notification,  GUI 

•  Implementation-Independent  Measurement  Tools. 

-  Measure  on-the-wire 

-  Response/Load 
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Synthetic  Workload  Generation  Tools 


Objective  -  Emulate  large,  dynamic  environments  of  100’s  of 

devices/services  and  10’s  of  control  points  /  clients. 

-  Dynamic  devices  providing  the  benchmark  service. 

-  Scripted  control  points  execute  measurement  scenarios. 


•  SDP  Experimenters  Toolkits 

-Drive  real  SDP  implementations 

-Emulate  the  behavior  of  a  large  number  of 
dynamic  devices 

-Emulate  the  behavior  control  points/ 
scripted  behavior  for  testing 

-  Jini  &  UPnP  Initial  development  complete 

-  SunMS  Jini,  Intel  UPnP  on  Linux  platforms. 

-  Target  of  100’s  of  devices  and  10’s  of 
control  points  met. 
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SDP  Performance  &  Scalability :  FY01  Accomplishments 

•  Methodology  and  scenarios  for  comparative  evaluations  of  SDPs 

•  Synthetic  workioad  generation/emulation  tools  for  Jini  and  UPnP. 

•  Performance  measurement  tools  for  SDPs  and  supporting  protocols. 

•  Initial  studies  of  client  query  scenarios  (see  examples  in  the  supplemental 
material). 

Anticipated  Additional  FY01  Accomplishments 

•  Begin  to  expand  test  bed  with  802.1 1  and  NIST  Net  emulated  WAN  links 

•  Complete  event  notification  &  control  studies 

•  Publish  complete  set  of  performance  results  for  Jini  and  UPnP 
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Assessing  Function,  Structure,  and  Behavior 

•  Compare  and  contrast  Jini  and  UPnP  (requires  us  to  complete  UPnP  model) 

•  Investigate  relationships  among  complexity,  quality,  and  performance 

•  Develop  model  of  Service  Location  Protocol 

•  Update  and  extend  generic  UML  model  to  include  messages  and  behavior 
Assessing  Performance,  Scalability,  and  Dynamic  Range 

•  Expand  test  bed  with  802.1 1  LANs  and  NIST  Net  emulated  WAN  Links 

•  Incorporate  Service  Location  Protocol  implementation  into  measurements 

•  Initiate  research  into  other  aspects  of  dynamic  range,  scaling,  and  fault  tolerance. 

•  Develop  large-scale  simulations  for  study  of  SDP  behavior  in  highly  dynamic,  ad 
hoc  network  environments. 
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Supplemental  Material 


•  Papers,  Software  Artifacts,  &  Presentations 

•  Interactions  &  Impact 

•  Other  DoD  Programs  Related  to  this  Project 

•  Individual  Quad  Charts  for  Modeling  &  Analysis 
and  Measurement  Portions  of  the  Project 

•  Sample  Modeling  &  Analysis  Results 

•  Sample  Measurement  Results 
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Papers 

•  Christopher  Dabrowski  and  Kevin  Mills,  “Analyzing  Properties  and 
Behavior  of  Service  Discovery  Protocols  using  an  Architecture-based 
Approach”,  submitted  to  Working  Conference  on  Complex  and 
Dynamic  Systems  Architecture,  to  be  held  December  2001 . 

•  Olivier  Mathieu,  Doug  Montgomery,  Scott  Rose,  “Empirical 
Scaling  Analysis  of  Service  Discovery  Technologies”,  work  in 
progress. 

Software  Artifacts 

•  Generic  UML  Model  (in  Rational  Rose  format)  of  Discovery  Protocols, 
including  specific  projections  to  Jini,  UPnP,  and  SLP 

•  Rapide  Model  of  Jini 

•  Jini  and  UPnP  Experimenter’s  Toolkits  consisting  of  synthetic 

workload  generation  tools,  scenario  scripts,  and  performance 
measurement  tools  for  SDPs. 
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Presentations 

•  Christopher  Dabrowski,  “Applying  ADLs  to  Assess  Emerging  Industry 
Specifications  for  Dynamic  Discovery  of  Ad  Hoc  Network  Services”, 
Dynamic  Assembly  for  System  Adaptability,  Dependability,  and 
Assurance  (DASADA),  DARPA  PI  Meeting,  January  31, 2001 

•  Christopher  Dabrowski  and  Kevin  Mills,  “Modeling  and  Analysis  of 
Service  Discovery  Protocols”,  Pervasive  Computing  2001,  May  2, 
2001,  Gaithersburg,  Maryland. 

•  Olivier  Mathieu,  Doug  Montgomery,  Scott  Rose,  “Empirical 
Measurements  of  Service  Discovery  Technologies”,  Pervasive 
Computing  2001,  May  2,  2001,  Gaithersburg,  Maryland. 
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Interactions  &  Impact 

•  Christopher  Dabrowski  and  Kevin  Mills  met  for  three  hours  with  Jim 
Waldo,  SUN’S  Jini  Architect,  to  discuss  the  NIST-developed  Rapide 
model  of  Jini  and  the  approach  to  analysis 

•  Subsequently,  Jim  Waldo  reviewed  and  commented  on  the  paper 
that  Chris  and  Kevin  wrote  describing  their  architecture-based 
approach  to  modeling  and  analysis  of  service  discovery  protocols 

•  Our  modeling  and  analysis  of  Jini  uncovered  several  areas  in  the 
Jini  natural-language  specification  that  could  be  improved. 

•  Empirical  measurements  of  Linux  UPnP  stack  led  to  detection  and 
correction  of  errors  in  scaling  mechanisms  (i.e.,  jitter  algorithms). 
NIST  staff  collaborated  with  Intel  Architecture  Labs  to  correct  the 
implementation  of  the  Linux  UPnP  jitter  algorithms. 

•  Other  issues  with  respect  to  the  impact  of  static  parameter  tuning  on 
UPnP  scaling  were  identified.  Future  research  will  examine  the  use 
dynamic  control  algorithms  to  address  these  issues. 
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Other  DoD  Programs  Related  to  this  Project 

•  Fault  Tolerant  Networks  -  DARPA  Program 
http://www.darpa.mil/ito/research/ftn/index.html 

•  OpenWings  -  Joint  Motorola-Sun-U.S.  Army  Program  (key  enabler 
of  Joint  Vision  2020) 
http://www.openwings.org/index.htm 

•  Organically  Assured  and  Survivable  Information  Systems  (OASIS)  - 
DARPA  Program 

http://www.darpa.mil/ato/programs/oasis.htm 

•  Dynamic  Assembly  for  System  Adaptability,  Dependability,  and 
Assurance  (DASADA)  -  DARPA  Program 
http://www.darpa.mil/ito/research/dasada/index.html 

•  Critical  Infrastructure  Protection  (CIP)  and  High  Confidence, 
Adaptable  Software  (SW)  Research  Program  of  the  University 
Research  Initiative  (URI)  -  Office  of  Naval  Research 
http://www.onr.navv.mil/sci  tech/special/cipswuri/ 


1/31/2002 


21 


ITL  Pervasive  Computing  Portfolio 


NIST 

National  Institute  of  Standards  and  Technology 

Technology  Administration,  US,  Department  of  Commerce 


NtST  CENTENNIAL 


Model  &  Analyze  SDP  Function,  Structure,  and  Behavior 


Objectives 

(1)  Provide  increased  understanding  of  the  competing 
dynamic  discovery  services  emerging  in  industry 

(2)  Develop  metrics  for  comparative  analysis  of 
different  approaches  to  dynamic  discovery  and  assuring 
quality  and  correctness  of  discovery  protocols 

(3)  Assess  suitability  of  architecture  description  languages  to 
model  and  analyze  emerging  dynamic  discovery  protocols 

Technical  Approach 

Develop  ADL  models  from  selected  specifications  for  service 
discovery  protocols  and  develop  a  suite  of  scenarios  and 
topologies  with  which  to  exercise  the  ADL  models 
Propose  a  set  of  consistency  conditions  &  constraints  that 
dynamic  discovery  protocols  should  satisfy 
Propose  a  set  of  metrics,  based  on  partially  ordered  sets, 
with  which  to  compare  and  contrast  discovery  protocols 
Analyze  ADL  models  to  assess  consistency  condition 
satisfaction,  and  to  compare  and  contrast  protocols 


Recent  Accomplishments: 


Products  &  Contributions 


•  Developed  a  generic  UML  model  encompassing  the 
structure  and  function  of  Jini,  UPnP,  SLP,  Bluetooth, 
and  HAVi 

•  Projected  specific  UML  models  for  Jini,  UPnP,  and  SLP 

•  Completed  a  Rapide  Model  of  Jini  structure,  function, 
and  behavior 

•  Drafted  and  implemented  a  scenario  language  to  drive 
the  Rapide  Jini  Model. 

•  Developed  a  set  of  consistency  conditions  and 
constraints  for  Jini  behavioral  model;  currently  being 
tested  using  scenarios. 

•  Discovered  significant  architectural  issue  in  interaction 
between  Jini  directed  discovery  and  multicast  discovery 


•  Rapide  specifications  of  Jini,  Universal  Plug  and  Play 
(UPnP),  and  Service  Location  Protocol  (SLP) 

•  Scenarios  and  topologies  for  evaluating  discovery  protocols 

•  Suggested  consistency  properties  for  service  discovery 
protocols 

•  Suggested  metrics,  based  on  partially  ordered  sets 
(POSETs),  for  comparing  and  contrasting  discovery  protocols 

•  Paper  identifying  inconsistencies  and  ambiguities  in  service 
discovery  protocols  and  describing  how  they  were  found 

•  Paper  proposing  consistency  conditions  for  service  discovery 
protocols,  and  evaluating  how  Jini,  UPnP,  and  SLP  fare 

•  Paper  comparing  and  contrasting  Jini,  UPnP,  and  SLP  at 
the  level  of  POSET  metrics 
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Measure  SDP  Performance,  Scalability,  &  Dynamic  Range 


Recent  Accomplishments: 


Objectives 

(1)  Provide  a  quantitative,  comparative  analysis  of  the 
performance  and  scaling  characteristics  of  emerging 
service  discovery  protocols  (SDPs). 

(3)  Design  methodologies  and  tools  for  performance  and 
scaling  measurement  of  SDPs  and  supporting  protocols. 

(4)  Develop  simulation  tools  for  large  scale  ad-hoc 
network  /  application  environments 

Technical  Approach 

■  Design  and  develop  experimenters  toolkits  for  conducting 
live  performance  analysis  of  SPDs  implementations. 

■  Propose  metrics  and  scenarios  for  comparing  the 
performance  of  multiple  SDP  protocols. 

■  Design  and  develop  simulation  models  of  emerging  SDPs 
and  adhoc  network  environments. 

■  Analyze  and  compare  the  performance  of  SDPs  based  upon 
testbed  measurements  and  simulation. 


Products  &  Contributions 


•  Designed  methodology  and  scenarios  for  comparative 
performance  evaluation  of  live  Jini  and  UPnP 
implementations. 

•  Established  testbed  with  Jini,  UPnP  implementations. 

•  Developed  synthetic  workload  generation  tools  for  Jini  and 
UPnP  capable  of  emulating  10’s-100’s  of  devices/services 
and  control  point  /  clients. 

•  Discovered  scaling  problems  with  Linux  UPnP  1.0 
implementation.  Conducted  initial  investigations  in  protocol 
/  parameter  tuning  to  increase  the  scalability  of  this 
implementation. 

•  Began  design  and  development  of  on-the-wire  performance 
measurement  tools  for  SDPs  and  supporting  protocols. 


•  Experimenter’s  toolkits  consisting  of  synthetic  workload 
generation  tools,  scenario  scripts,  and  performance 
measurement  tools  for  SDPs. 

•  Measurement  methodologies  and  tools  for  SDPs  and 
supporting  protocols. 

•  Ad-hoc  network  simulation  environment  and  SDP  protocol 
models. 

•  Publications  /  standards  contributions  providing  quantitative 
analysis  of  the  relative  performance  and  scaling  properties 
of  SDPs. 


1/31/2002 


23 


ITL  Pervasive  Computing  Portfolio 


NIST 

National  Institute  of  Standards  and  Technology 

Technology  Administrotjon,  US,  Department  of  Commerce 


Sample  Modeling  &  Analysis  Results 


1/31/2002 


24 


ITL  Pervasive  Computing  Portfolio 


O 


NIST 


National  Institute  of  Standards  and  Technology 

Technology  Administration,  US,  Department  of  Commerce 


tST  CENTE 


Jini  Has  Two  Discovery  Modes  Encompassing 
Three  Discovery  Processes 


This  is  not  a  result,  but  background 
needed  to  understand  the  next  few 
slides. 


SU,  SM,  or 
SCM 


(/) 

(0  0) 
O  "O 

o 

"5  S 


"O 

CD  O 


AGRESSIVE  DISCOVERY 


Probe  groups( )  SCMs  ( ) 


TCP  Connect 
Request  SCM  API 


SCM  APL 


LAZY  DISCOVERY 


TCP  Connect 


Request  SCM  API 


SCM  API 


DIRECTED  DISCOVERY 


TCP  Connect 


Request  SCM  API 


SCM  API 


5\RDA^ 


SCM 
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Local  Interference  between  Directed  and  Multicast  Discovery 


Scenario 

SM4 

SCMS 

Based  on  one 
possible 
interpretation  of 
ambiguous 
specification 


GroupJoin  GROUP2 


Probe  SM2  GROUP2 


Discovered  SCMs 
(SCM3) 


GroupLeave  GROUP2 


Register  SM4  SD1 
Discover  SCMS 


Registered  Services 
(SM4,  SD1) 


AddSCM  SCMS 

Discovered  SCMs 
(SCMS) 


No  Duplicates  Allowed 


Discovered  SCMs 
0 


CC1  Violated 


Lease  Expired 
SM4  SD1 


Consistency  Restored 


Registered  Services 
0 


Registered  Services 
(SM4,  SD1) 


Registered  Services 

0 


For  All  (SM,  SD,  SCM):^ 

(SM,  SD)  IsElementOf  SCM  registered-services  (CC1) 
implies  SCM  IsElementOf  SM  discovered-SCMs 
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Remote  Interference  between  Directed  and  Multicast  Discovery 


Scenario 

SM4 

SCM1 

1 

1 

1 

' 

AddSCM  SCM1 

1 

1 

1 

- - 

Discover  SCM1 

Based  on  a  second 
possible 
interpretation  of 
ambiguous 
specification 


Discovered  SCMs 
MD() 

DD  (SCM1) 


GroupJoin  GROUP1 


Registered  Services 
(SM4,  SD1) 


Discovered  SCMs 

I  i-ouna  tjKuur  i  ^uivn^^ 

1  - - 

1  _ — 

• — :: — 

Registered  Services 

MD  (SCM1) 

^  +  j 

0 

DD  (SCM1) 

1 _ Register  SM4  SD1 

GroupLeave  GROUP1 


Discovered  SCMs 
MD  0 

DD  (SCM1  ) 


I 


Registered  Services 
(SM4,  SD1) 


Registered  Services 
0 


Cancelled  SM4  SD1 


CC2  Violated 


For  All  (SM,  SD,  SCM): 

SCM  IsElementOf  SM  discovered-SCMs  &  (CC2) 

(SD)  IsElementOf  SM  managed-services 

implies  (SM,  SD)  IsElementOf  SCM  registered -services 


1/31/2002 


27 


ITL  Pervasive  Computing  Portfolio 


O 


NIST 

National  Institute  of  Standards  and  Technology 

Technology  Administration,  US,  Department  of  Commerce 


NtST  CENTENNIAL 


^RDA^ 


Insensitivity  to  Dynamic  Changes  in  Group  Membership  by  SCM 


Specification 
incomplete  with 
regard  to  this 
issue 


For  AM  (SM,  SD,  SCM): 

SCM  IsElementOf  SM  discovered-SCMs  &  (CCS) 

(SM,  SD)  IsElementOf  SCM  registered-services  & 

NOT  (SCM  IsElementOf  SM  persistent-list) 

implies  Intersection  (SM  GroupsToJoin,  SCM  GroupsMemberOf) 
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A  Registration  Race  Condition 


^RDA^ 


Scenario 

SU7 

SCM1 

SM4 

AddSCM  SCM1 


Discover  SCM1 


Specification 
does  not  mention 
this  issue,  which 
could  catch 
application 
programmers 
unaware  and  lead 
to  unexpected 
behavior 


FindService  SCM1  X 


Found  SCM1 


AddSCM  SCM1 


Notify  SCM1  X  Added 


Matched  Services 
0 


Request  Added 


CC4  Vioiated 


Requested 
Notifications 
(SU7,  X) 


For  All  (SM,  SD,  SCM,  SU,  NR): 

(SU,  NR)  IsElementOf  SCM  requested-notifications  &  (CC4) 

(SM,  SD)  IsElementOf  SCM  registered-services  & 

Matches((SM,  SD),  (SU,NR)) 

implies  (SM,  SD)  IsElementOf  SU  matched-services 
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Sample  Measurement  Results 

Notes: 

•  Example  results  of  Client  Active  Query  scenarios. 

•  Query  experiments  measure  latency  /  load  through  the  client  download  of 
the  service  proxy  /  description. 

•  Results  show  two  scenarios  for  Jini 

•  Jini  Restart  -  includes  overhead  of  client  discovery  and  first  access  of 
look  up  server. 

•  Jini  -  query  from  “warm”  client,  after  lookup  server  Discovery  has 
completed. 

•  Default  UPnP  jitter  value  is  2.5  seconds 

•  In  device  poll  experiment,  jitter  values  of  5.5  sec  (64  services)  and  1 1 
sec  (128  services)  were  used. 


1/31/2002 


30 


ITL  Pervasive  Computing  Portfolio 


NIST 

National  Institute  of  Standards  and  Technology 

Technology  Administration,  US,  Department  of  Commerce 


NtST  CENTENNIAL 


^RDA^ 


Linux  UPnP  Scaling  Problems 

•  Problems  encountered  in  achieving  initial  scaling  goals  for  device 
emulation  tools. 

-  UPnP  scalability  above  40  devices  a  function  of  protocol  tuning  parameters 
(e.g.,  response  jitter,  multicast  retransmission  factor). 

-  Errors  in  implementation  of  jitter  algorithms 

UPnP  Jitter  Sensitivity 


Jitter  (sec) 
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Some  Example  Results:  JInl  vs  UPnP  Discovery 


Performance  of  Query  for  Specific  Service:  “Find  service  X” 
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Some  Example  Results:  Jini  vs  UPnP  Discovery 


Utilization:  Query  by  Unique  ID 
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Performance  of  Query  for  Specific  Service:  “Find  service  X” 
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Some  Example  Results:  JInl  vs  UPnP  Discovery 


Performance  of  “anycast”  Query:  “Find  one  instance  of  type  X” 


1/31/2002 


34 


ITL  Pervasive  Computing  Portfolio 


NIST 


National  Institute  of  Standards  and  Technology  p 

Technology  Administration,  U,S,  Department  of  Commerce  nist  centennial 


5\RDA^ 


Some  Example  Results:  Jini  vs  UPnP  Discovery 


Utilization:  Query  for  1  Service  of  Type  X 


Performance  of  “anycast”  Query:  “Find  one  instance  of  type  X” 


1/31/2002 


35 


ITL  Pervasive  Computing  Portfolio 


NIST 

National  Institute  of  Standards  and  Technology 

Technology  Administration,  US,  Department  of  Commerce 


NtST  CENTENNIAL 


^RDA^ 


Some  Example  Results:  JInl  vs  UPnP  Discovery 


Performance  of  Service/Device  Poll:  “Find  all  active  services” 
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Some  Example  Results:  Jini  vs  UPnP  Discovery 


Utilization:  Query  All  Services 


Performance  of  Service/Device  Poll:  “Find  all  active  services” 
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